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Abstract 


The study presented in this paper examines the feasibility of using MOOCs as a learning 
environment in academic courses. This paper focuses on the students who participated in two 
MOOCs offered by Tel Aviv University (TAU) during the year 2013. The preliminary findings of 
this pilot study illustrate the scope of student activity, the learning intensity, and learner path. In 
addition, attitudes of TAU students who participated in these courses as part of their curriculum 
are presented. From TAU’s perspective, the presented MOOCs are considered to be a successful 
experience for all those involved: the students, who were very satisfied with their learning and 
high achievements; the lecturer team, who were very enthusiastic and satisfied with the learning 
process as well as the new experience; and the University policy makers, who took the challenge 
and integrated this new model of learning into the academic environment. 
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Introduction 

Massive open online courses (MOOCs) are the latest revolution in online teaching and learning 
(Liyanagunawardena, Adams, & Williams, 2013). These academic courses are available to the 
general public, worldwide; do not have any preconditions; and are usually free of charge 
(Johnson, Adams Becker, Cummins, Estrada, Freeman, & Ludgate, 2013; Allen & Seaman, 2014; 
Adams & Williams, 2013; Fini, 2009; Stewart, 2013). MOOCs are offered by a variety of 
initiatives, such as Coursera, Udemy, MITx, edX, Udacity, which include the world's leading 
universities: Stanford, Harvard, and MIT. The courses are taught by some of the most leading- 
edge professors around the world, in various fields. They allow for flexible learning at any time 
and any place, integrating a variety of tasks into the course structure. The structure and scope of 
each course varies, depending on the characteristics and needs of the course curriculum, and the 
instructor's decision. A major emphasis is put on selecting suitable course subjects, instructors, 
the appropriate structure for high quality video production, and a friendly interface. Such courses 
developed with these guidelines have altered the conception of education and created a different 
culture of learning, one which involves collaborative social learning combined with various social 
tools (such as discussion groups and assessment process management tools). This type of course 
development enables the teaching of mass online courses. 

In the year 2013, Tel Aviv University (TAU) joined the community of leading universities that 
provide MOOCs, after developing high-quality academic courses that are accessible to the public. 
TAU offers three academic MOOCs, taught in English, in the fields of archeology, history and 
science. The courses are available through Coursera (see https: // www.coursera.org) . an 
international education company that offers over 620 academic courses taught by the best 
lecturers from 108 academic institutions worldwide, including a number of leading universities, 
such as Princeton and Stanford. These courses are offered as a public service and as future 
training for the information society. In addition, as a pioneer step, TAU policy makers have 
allowed TAU undergraduate students to take these MOOCs as part of their current curriculum 
and receive academic credit for them upon completion. 

Although there is a debate about the advantages of MOOCs and their potential negative 
consequences (Borden, 2014; Decker, 2014; Samuels, 2014; Shirky, 2012; Carey, 2013), 
universities cannot ignore the impact MOOCs have on higher education institutions. Therefore, it 
is important to explore the feasibility and advantages of MOOCs as part of the academic 
curriculum. And hence, the main goal of this research is to examine the feasibility of using 
MOOCs as a learning environment in academic courses. This paper will focus on the students who 
participated in the first two TAU MOOCs during the year 2013 - archeology and life sciences (the 
third is still ongoing). It will present the scope of student activity, the learning intensity, and 
learner path, in addition to attitudes of TAU students who participated in these courses as part of 
their curriculum for their degree. 
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Background 

The rapid growth of MOOCs, which are offered by the best universities in the world through 
varied initiatives (such as Coursera, Udemy, edX, MITx, Udacity, and OpenupEd) stimulate 
reactions of enthusiasm, and concern as well (Krause & Lowe, 2014; Abhijit & Duflo, 2014; Yuan, 
Powell, 2013). On one hand, spirits of innovation, new pedagogies and greater accessibility to 
education can be found (Kop, Fournier, & Mak, 2011; Milligan, Littlejohn, & Margaryan, 2013). 
On the other hand, criticism and objections are increasing along with evaluation studies and 
position papers whose attitudes towards MOOCs are suspicious or resistant (Samuels, 2014). To 
some extent, this situation balances the enthusiasm that has gripped the public. 

A MOOC is an online course with the option of free and open 
registration, a publicly shared curriculum, and open-ended 
outcomes. MOOCs integrate social networking, accessible online 
resources, and are facilitated by leading practitioners in their 
fields of study. Most significantly, MOOCs build on the 
engagement of learners who self-organize their participation 
according to learning goals, prior knowledge and skills, and 
common interests. (McAuley, Stewart, Siemens, & Cormier, 2010) 

Some of the MOOCs provide a statement of accomplishment for students who meet the passing 
criteria of the course. In addition, some of the institutions offer the option to earn an official 
verified certificate, which costs money and securely links the student's coursework to the 
student's identity (e.g., Coursera's "Signature Track"). These certificates, however, do not include 
course credit towards an academic degree. Although all MOOCs have their large scale of 
registered students and free access in common, they have bifurcated in two very distinct and 
separate pedagogical types of courses, known as xMOOCs and cMOOCs (Siemens, 2013; 
Rodriguez, 2013). xMOOCs represent online learning environments which focus on scalability 
and address very large classes, while cMOOCs represent online learning environments which 
focus on community and connections, and are designed based on connectivism and connective 
knowledge (Ravenscroft, 2011). These MOOCs continue to use the acronym MOOCs, which was 
first coined by Siemens and Downes (Cormier & Siemens, 2010). There are researchers who argue 
that the xMOOCs might be better suited for studying a wide range of knowledge that can be 
learned through repetitive practice, while the cMOOCs enable learners to obtain "higher order 
creative skills” (Griinewald, Meinel, Totschnig, & Willems, 2013). Thus, these two pedagogical 
types shouldn't be treated or evaluated in the same way (Daniel, 2012). Both types of MOOCs 
emphasize dialogue as an important element in the learning process. Almost every MOOC actively 
encourages dialogue and discussion among course participants. Furthermore, dialogue is actually 
perceived to be the primary mechanism for maintaining connections between different ideas, 
which are the base upon which knowledge is developed (Ravenscroft, 2011). 
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The MOOCs phenomenon is controversial, both for its effectiveness and in terms of its potential 
implications on higher education. Some researchers argue that MOOCs are still not effective in 
regards to student needs (Adamopoulos, 2013). One piece of evidence is the low retention rate of 
students in these courses (Clow, 2013; Lewin, 2013). Furthermore, they claim that MOOCs have 
negative potential consequences on higher education (Decker, 2014; Samuels, 2014), mostly on 
research and development. MOOCs initiatives may disrupt the structure of higher education 
because of their business model, which dismantles the relationship between the three 
components that university activities are built on: teaching, research, and granting credit 
approval for courses. These researchers are concerned that the traditional business model of the 
university will eventually need to shift to accommodate the existence of credit-earning MOOCs 
(Decker, 2014). Other researchers (Shirky, 2012; Carey, 2013) believe in the tremendous potential 
contribution of MOOCs. They argue that MOOCs offer flexibility, affordable access, and fast-track 
completion at a low cost for whoever is interested in learning (Yuan, Powell, 2013). They claim 
that higher education institutions will have to be flexible and aware of the changes, even in light 
of the criticism raised by recent studies. Regarding students, several factors can be found for their 
motivation in using MOOCs (Belanger & Thornton, 2013; Zutshi, O’Hare, & Rodafinos, 2013): to 
support lifelong learning or to gain an understanding of the subject matter, with no particular 
expectations for completion or achievement; for fun, entertainment, the social experience, and 
the intellectual stimulation; for the convenience, often in conjunction with barriers to traditional 
education options; and to experience or to explore online education. 

Academic accreditation is one of the key issues that arises in public debate regarding MOOCs’ 
effect on the higher education system (Dolan, 2014). Changes in academic recognition are usually 
based on localized initiatives of various academic institutions (Eaton, 2012; ACE, 2012; 
Masterson, 2013), such as Antioch University, which became the first US institution to offer credit 
for MOOC learning through Coursera. At this stage, the changes are bottom-up, not top-down, as 
a result of planed policy and official regulation of governmental institutions or other central 
organizations in the USA higher education system. It is important to note that, in general, the 
higher education system in the USA is characterized by decentralization and high variability 
between institutions and between states; therefore, this phenomenon is not unusual. However, 
some of the most important USA central organizations in higher education have published 
statements recently in which they acknowledge their growing awareness of the importance of the 
debate in this field as well as their attempts to match system practices to the developing reality. In 
addition, academic recognition issues related to MOOCs were published recently in the UK as 
well. According to the "Universities UK", the representative organization for UK universities 
(2013), currently there are still no statements of systematic recognition of MOOC studies at 
higher education institutions in the UK; however, there are specific instances where UK higher 
education institutions have decided to accredit MOOCs. 

The MOOCs presence is hard to ignore and the process of its adoption and expansion must be 
accompanied by exploring difficult questions such as: What are the problems that MOOCs could 
solve (Laurillard, 2014)? Do MOOCs constitute a method which aims to reduce costs, to give mass 
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access to academic information, to improve the learning process or make it more efficient? Are 
MOOCs designed to close gaps, or are they designed to encourage learning and excellence? There 
is often tension between these two important objectives - closing gaps and learning excellence, 
and it is very difficult to achieve both of these goals simultaneously. 

At the pinnacle of the debate on MOOCs it seems that even if they could have a negative impact 
on higher education, there is a responsibility to examine their advantages and obstacles, and to 
make some decisions. TAU joined the Coursera initiative in order to appraise the benefits of 
MOOCs to the university and academic instruction. These benefits include the promotion of the 
institution’s status on a global scale, attraction of worldwide students, and the promotion of the 
university’s domestic objectives, which are related to online learning and web supported academic 
instruction at TAU. This paper presents TAU’s experience in implementing MOOCs as part of the 
academic curriculum and tries to offer insights for further integration of MOOCs in higher 
education. 


Method 

Three courses were developed in Coursera and were offered to TAU students, as well as to the 
general public, worldwide. The main research goal was to examine the feasibility of using MOOCs 
as a learning environment in academic courses for undergraduate students. This was examined 
through the following aspects: a) the scope of student activity, b) the student learning intensity, c) 
the learner path during the online course, and d) the attitudes of TAU students who participated 
in these courses as part of their curriculum for their degree. 

Participants and Data Collection 

This study focuses on the first two courses, since the third is still ongoing. 47,691 students 
registered in the first two MOOCs courses during the year 2013. 121 of the students were TAU 
students, and were registered for accreditation. Data regarding the students' range of activities, 
their intensity of involvement in the course, and their attitudes were derived from two main 
sources: 


• Coursera log files - the first source was Coursera's database, which provides data from 
the learning system web logs regarding all participating students. During the courses, 
student activity data was automatically accumulated, documenting student participation 
in each activity of the course. 

• University teaching survey - the second data source was TAU instructional surveys, 
which were conducted electronically at the end of each course and provide data on the 
attitudes of TAU's students. The survey included 16 questions and consisted of three 
sections: the first section included demographics questions (e.g., gender, education); the 
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second section asked students to rate each of nine specific pedagogical aspects (e.g., the 
lessons were clear, interesting, well organized, overall satisfaction from the course and 
instructor) on a 7-point Likert-type scale ranging from 1 (very low) to 7 (very high); and 
the third section included two open questions dealing with satisfaction from the 
instruction and suggestions for improvement. 

Course Description and Delivery 

The first two courses that were chosen for this study were: "What a plant knows (and other things 
you didn’t know about plants)"; and "The fall and rise of Jerusalem - Judah under Babylonian 
rule". The development process and production of these MOOCs required tremendous attention 
and commitment from the instructional teams. The professors needed to acquire new teaching 
skills, such as how to lecture in front of a camera without students, which is very different from 
what they usually do. In addition, they had to familiarize themselves with the Coursera learning 
management system (LMS) and infrastructure, in order to adjust their pedagogy and course 
material. Each professor, along with their assistant, developed the course content in accordance 
to the pedagogical model, which was built around video lectures, quizzes, and forums. As the 
prerecorded lessons were put into use, content and assignments were adjusted and/or added 
gradually. 

The duration of each course was six to eight lessons, based on the professor's preference, with 
course materials and insights taken from previous MOOCs (Andres, 2013). Students, who 
completed the courses with a grade of at least 78, comprised of 50% quizzes and 50% final exam, 
received a Statement of Accomplishment. It should be noted that these courses do not earn the 
student academic credit, unless they are TAU undergraduate students. TAU students are allowed 
to take these courses as part of their academic curriculum; however, they are required to take the 
final exam on campus, in addition to completing the assignments and the official online course 
exam. 

"What a plant knows" was a course that intended to present an intriguing and scientifically valid 
look at how plants themselves experience the world—from the colors they see to the sensations 
they feel, highlighting the latest research in genetics and other relevant fields. The main goals 
were to introduce basic plant biology by exploring plant senses (sight, smell, hearing, touch, taste, 
balance), to introduce biological research and scientific methods, and to get the student to 
question life in general and what defines us as humans (Coursera, 2013). Every week, a different 
topic was presented and discussed via video lectures, professor announcements, reading 
recommendations, a quiz, and discussion forums. Videos included illustrated presentations, 
interactive questions (open and closed), and hyperlinks to other resources. A final exam was 
conducted at the end of the course, consisting of multiple choice questions. 

"The fall and rise of Jerusalem" course presented the history of Jerusalem, from the time of the 
Judean Kingdom during the 6th century B.C.E., to Babylonian occupation. The course included 
guest lectures by leading scholars, dealing with the archaeological and biblical aspects of this 
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debated topic (Coursera, 2013). Each week, a new topic was taught using 6-12 short videos. The 
videos included presentations and illustrations, interactive questions (open and closed), and links 
to the course forums and other sources. In addition, instructor messages were sent to students 
prior to each class along with reading recommendations. A final exam was conducted at the end of 
the course, using the peer review method for evaluation. 

Findings 


The scope of student activity - Data regarding the scope and intensity of activity was taken 
from Coursera's log files at the end of each course. Students from 126 different countries signed 
up for these courses; the highest rates of participation were from the United States and Canada 
(41%) and various European countries (28%). Table 1 presents the total number of students who 
registered for the courses, the number of active students and the number of students who 
completed the assignments for each course. 

Table 1 

Course Participation 


Course name 

Signed up 

Active 

Completed 

Signed up - 

Completed 



throughout 

course 

TAU 

course 



the course 

assignments 

students 

assignments - 
TAU students 

What a plant 
knows 

32,009 

22,107 

2,318 

93 

89 

The fall and rise of 
Jerusalem 

15,682 

10,099 

287 

28 

17 


Of the 32,009 students who signed up for the first course, 2,318 students fully completed it. 89 of 
those students were from TAU. This data shows that 10% of the total active students (those who 
accessed the course items at least once) completed the course, or 7% of those who registered. 
These percentages match previously reported data in literature, showing that approximately 7% - 
10% of students who sign up for a MOOC actually complete it (Daniel, 2012; Kolowich, 2013; 
Roller, 2013). However, when examining the number of students who completed the course in 
comparison to those who registered for the "Signature Track" (and paid), the percentage was 
higher (62.5%). In regards to TAU students, the number of students who completed the course 
was even higher (97%), and their average final grade was 91.07. Focusing on the second course, 
only 287 of the 15,682 registered students completed the course and successfully submitted all of 
the assignments. 17 students were from TAU, and their average final grade was 88.88. This data 
shows that the second course had a relatively lower percentage of completion than the first 
course: approximately 2% of the total active students, 40% of those who registered for the 
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"Signature Track", and 60% of TAU students. Possible explanations could be the high-level 
subject, the depth of the material taught, and the peer-based final evaluation, which requires a 
greater time investment from the student. TAU students, who completed the second course, were 
required to take an additional final exam of open questions conducted at the University. 

The intensity of usage was examined based on the following parameters: activity related to 
video lessons, scope of posts made on the forums, and rate of quiz submission. Table 2 presents 
the various activities by type of task as well as the student participation for each task. As shown, 
the highest volume of activity was in the video lessons. The total number of video lessons in both 
courses ranged from 50 to 53, which had been observed by 80% of the active students. Each 
student watched between 18 and 23 video lessons, on average, during the course. Examining 
student activity in the forums shows lower rates, compared to the video lessons. In each of the 
two courses, six forums were opened with various topics (e.g., general discussion, study groups, 
assignments and technical issues). In the first course, 9% -11% of the active students participated 
in the forums and posted comments and messages. Each student wrote an average of 
approximately 3 posts and 2 comments. In the second course, the rate of participation was even 
lower and only 3% - 6 % of the active students participated and posted messages. Each student 
wrote an average of approximately 3 posts and 5 comments. Looking at the quiz tasks in the first 
course, which included six quizzes, 40% of all active students participated. However, in the 
second course, which included five quizzes, only 18% of all active students participated. In both 
courses, each student submitted an average of four quizzes. Comparing student activity from both 
courses, we learned that although the total number of participants varied greatly, the average 
participation for a student in all activities was almost the same. 
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Table 2 

The Intensity of Usage by Type of Activity 


Type of activity/ Name of course 

What a plant knows 

The fall and rise of 
Jerusalem 

Videos 

Number of videos 

50 

53 

Number of video views 

409,193 

147,567 

Percent of students who watched the videos 

80% 

79% 

Percent of videos watched by students 

46% 

35% 

Forums 

Number of forums 

6 

6 

Number of threads 

909 

346 

Number of posts 

6,720 

2,223 

Number of participants who posted 

2,333 

616 

Number of comments (replies to posts) 

5,539 

1,534 

Number of participants who commented 

1,918 

296 

(replied to a post) 



Quiz 

Number of quizzes 

6 

5 

Number of quiz submissions 

30,371 

6,158 

Number of participants who submitted 

8,512 

1,736 

quizzes 



Final exam 

Number of successful submissions 

2,318 

287 


The learner path was analyzed according to the various assignments during each course. 
Figures 1 and 2 present the student participation in each of the courses, throughout the duration 
of the course. During the first few weeks of each course, there were a significantly high number of 
students participating in all of the activities. This number gradually decreased as the courses 
progressed. However, it is interesting to note that prior to the final test, there was an increase in 
the number of students who entered the forum. This activity, in both courses, lasted for 
approximately three weeks after the end of the teaching period and the final assignment 
submission. 
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Weeks 


Figure 1. Student participation in the course, "What a plant knows". 



Weeks 


Figure 2. Student participation in the course, "The fall and rise of Jerusalem". 


The attitude of TAU students towards MOOCs courses being a part of their curriculum 
was analyzed based on the results of the teaching evaluation surveys. 121 TAU students 
participated in the MOOCs: 93 students in the first course - "What a plant knows", and 28 
students in the second course - "The rise and fall of Jerusalem"; most of them were 2 nd year 
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undergraduate students. In the first course, participants had a similar gender ratio, whereas the 
second course had a majority of male students (82%). Figure 3 presents the findings of the 
surveys from both courses: In general the students in both courses mentioned that they were 
satisfied from learning in the MOOCs. However, the students in the course, "What a plant knows", 
rated a higher level of satisfaction (very high) in all aspects (general average = 6.39 on a scale of 1 
to 7) compared to the students in the course, "The rise and fall of Jerusalem" (overall average = 
5.14). One explanation mentioned by the students was that the course, "The rise and fall of 
Jerusalem", was difficult to understand for students with no previous background in the subject. 



General assessment of the instructor 
The lecturer attitude was positive 
General average 
The lessons were organized 
General assessment of the course 
The lessons were interesting 

The lessons were clear 

The course website contributed to the 
learning 

Classes inspired an intellectual challenge 


76543210 


Figure 3. Attitude of TAU students towards MOOCs. 


In analyzing the open questions, several interesting comments were mentioned by the students: 
The students in the course, "What a plant knows," indicated that the subject matter and content 
was clear, interesting, inspiring, well organized, and diverse. The video lesson learning method 
enabled them to experience activities which are not available in traditional classes, such as 
virtually visiting relevant sites and interviewing visiting lecturers. They also mentioned the 
valuable convenience of flexible learning - any place and any time, according to their schedule. In 
addition, several suggestions for improvement were made, such as receiving specific guidelines 
regarding course assignments and especially the final test, adding subtitles to videos to assist with 
any language issues, and addressing the imbalance between the difficulty level of the assignments 
and quizzes versus the final exam. Students mentioned their satisfaction with the lecturers of both 
courses, noting that the instructors were clear, interesting, engaging, stimulated thinking, and 
had an active presence in the forum tasks. Finally, the students in the course, "The fall and rise of 
Jerusalem," claimed that the course subject matter was difficult even for people who major in 
archeology. 
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Conclusions 

In recent years, the use of MOOCs offered by leading universities to the general public has 
expanded. However, only 5% of higher education institutions in the USA offer such courses and 
only 9.3% report that they are still in a consideration phase. Moreover, only 25% of academic 
policy makers believe that MOOCs are a sustainable and reliable method for online courses over 
time (Allen & Seaman, 2014). In addition, fewer universities allow their students to take the 
MOOCs as part of their academic curriculum (Eaton, 2012; ACE, 2012; Masterson, 2013); 
nevertheless, more universities are increasingly exploring ways to incorporate MOOCs as part of 
their academic curriculum in different models (Firmin, Schiorring, Whitmer, Willett, Collins & 
Sujitparapitaya, 2014; Taneja & Goel, 2014; Joseph & Nath, 2013). 

Although the debate concerning benefits and disadvantages of MOOCs to higher education is still 
ongoing (Borden, 2014), as well as the acceptance and accreditation of these courses by the 
universities, we cannot stop the "train" that has already left the station by ignoring the 
educational trends and the continuous penetration of emerging information and communication 
technologies (ICTs) into the education system. These new technologies will enable the 
development of innovative virtual learning environments, which will provide a variety of learning 
models such as MOOCs. These environments are focused on flexible learning any time anywhere, 
are context based, and are built up dynamically around content through learner participation, 
creation of user-generated content, and collaboration. Furthermore, they have the potential to 
give rise to communities of practice, enhance learning, and build personal learning networks 
(Chattopadhyay, 2014). These new models raise many questions concerning the transition from 
the physical space of the classroom, where the students and lecturer are present, to a virtual space 
where the students and the instructor use computers for learning, communicating, dialogue, 
encouraging learning, trying to prevent dropout, giving feedback, evaluating work, and so on. 

One of the major challenges concerning the penetration of MOOCs is the university accreditation 
given to these courses. TAU took this challenge and developed three MOOCs in different fields of 
study (archeology, biology, and Middle Eastern studies). These courses are offered to the general, 
worldwide public, and are accredited to TAU students as part of their academic curriculum. 
Additionally, a research and practicum group was created to accompany course development and 
gain critical experience in online instruction. 

The pilot study presented in this paper illustrates the feasibility of implementing MOOCs as part 
of the academic curricula for undergraduate students, and describes the scope and intensity that 
exists in TAU courses in terms of learning, teaching, and assessing, especially during the early 
stages of a course. The preliminary data presented in this article indicate that the number of 
worldwide students who participated in these courses was very impressive (about 50,000 
subscribers of which over 30,000 were active in two courses). The MOOCs penetration into the 
higher education system offers an alternative learning model, which includes a wide variety of 
activities, such as video lessons, interactive participation in forums, online tasks, and feedback. 
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The TAU MOOCs are considered to be a successful experience for all those involved: the students, 
who were very satisfied with their courses and their achievements; the lecturers, who were very 
enthusiastic and satisfied with the learning process, as well as the new experience; and the 
University policy makers, who took the challenge and integrated this new model of learning into 
the academic environment. From the academic point of view, following the MOOCs success at 
TAU, further activities will be considered, such as increasing the number of MOOCs, integrating 
them into the academic curricula, and creating an international academic program with other 
universities for special issues. Thus, integrating MOOCs in academic institutions for 
undergraduate learners could provide several advantages: flexible learning environments; 
enrichment with courses by leading instructors in various fields; and exposure to intercultural 
learning experiences from which 21 st century skills can be attained. On the other hand, we must 
take several issues into consideration: developed economical models, academic pedagogical 
standards, quality assurance, and student needs at the university. 

Most recent studies (Cormier & Siemens, 2010; Daniel, 2012; Rodriguez, 2012: Swan, Day, Bogle, 
& van Prooyen, 2014) on the MOOCs phenomenon mainly examine the benefits of this model 
from pedagogical, social, and technological aspects; however, future studies should also focus on 
the processes of running MOOCs, the advantages of integrating them into the academic 
curriculum, as well as on issues such as copyright, privacy, cultural differences (including 
language), and economic and organizational aspects. 
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